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ABSTRACT 

Over  the  last  two  decades  MIT  Lincoln  Laboratory  (MITLL)  has  pioneered  the  development  of  enabling 
technologies  and  systems  for  high-sensitivity,  photon-counting,  scanning  three-dimensional  imaging  laser  radar 
(3D  ladar).  Examples  include  the  ALIRT  mapping  and  MACHETE  foliage-penetrating  ladars.  While  these  and 
other  systems  have  been  transitioned  to  operation,  there  is  a  need  to  maintain  a  testbed  for  novel  phenomenology 
investigation  and  validation  of  new  sensor  architectures.  To  that  end,  MITLL  has  developed  an  airborne  optical 
system  testbed  (AOSTB)  that  is  re-configurable,  allows  for  roll-on  roll-off  capability,  and  can  accommodate 
multiple  sensors  on  a  low-operating-cost  Twin  Otter  aircraft.  AOSTB  mission  areas  include  wide-area  down¬ 
looking  high-resolution  imaging,  side-looking  and  up-looking  laser  ranging  and  tracking,  and  sensor  fusion  with 
EOIR  cameras  and  hyperspectral  payloads.  We  describe  the  AOSTB  ladar  system,  present  recently  collected 
airborne  down  and  side-look  3D  data,  and  discuss  testbed  configurations  that  can  support  various  defense  and  non- 
DoD  applications. 

Key  Words/Topics:  Laser  Applications,  LIDAR,  Imaging  3D  LADAR,  Remote  Sensing,  Photon  Counting,  Active  Optics 

1.0  INTRODUCTION 

We  report  the  development  of  an  airborne  3D  ladar  utilizing  a  single-photon-sensitive  avalanche  photodiode  (APD) 
array  and  short-pulse  laser.  The  detector  technology  is  based  on  arrays  of  short-wave  infrared  (SWIR)  APDs 
operating  in  Geiger  mode.  The  laser  technology  is  based  on  diode-pumped  passively  Q-switched  lasers.  We  describe 
the  ladar  system  performance  when  operated  from  a  Twin  Otter  aircraft  and  present  high-resolution  daytime  and 
nighttime  3D  imagery.  We  discuss  the  implication  of  these  developments  and  the  future  direction  of  imaging  3D 
ladars  as  stand-alone  payloads  and  as  part  of  a  fusion  of  active/passive  EOIR  sensors. 

The  3D  ladar  concept  is  straightforward.  Light  from  a  short-pulse  laser  illuminates  a  scene  of  interest.  The 
reflected  light  is  imaged  onto  a  two-dimensional  (2D)  grid  of  detectors.  Rather  than  measuring  intensity,  as  in  a 
conventional  camera,  these  detectors  measure  the  photon  time-of-flight  and  therefore  the  object  distance  [1,  2].  With 
each  pixel  encoded  with  range  information,  photon-counting  ladars  can  produce  an  angle-angle-range  or  3D  image  on 
a  single  laser  pulse.  As  a  result  of  the  receiver  having  a  Geiger-mode  avalanche  photodiode  (GMAPD)  array,  which  is 
sensitive  to  single  photons,  one  can  relax  the  requirement  on  the  laser  transmitted  power,  and  hence  reduce  the  overall 
system  size,  weight,  and  power  (SWaP)  requirements,  while  allowing  for  closure  of  the  optical  link  budget.  This  is 
important  for  airborne  applications  where  payloads  are  constrained  by  numerous  practical  factors.  When  coupled  with 
a  fast  scanning  beam-pointing  mechanism,  photon-counting  laser  radar  systems  can  provide  high  area  coverage  rates 
in  excess  of  100  km2/hr.  Various  ground-based  and  airborne  systems  have  been  demonstrated  at  MITLL  over  the  last 
two  decades,  such  as  JIGSAW,  ALIRT  (Airborne  Ladar  Imaging  Research  Testbed),  MACHETE  (Multi-look 
Airborne  Collector  for  Human  Encampment  and  Terrain  Extraction),  and  the  Airborne  Optical  Systems  Testbed 
(AOSTB),  described  herein.  These  systems  have  logged  thousands  of  operational  hours  over  the  years,  demonstrating 
their  utility  in  open-terrain  3D  mapping  and  foliage-penetrating  (FOPEN)  imaging  for  a  variety  of  commercial  and 
military  applications  [4,5]. 
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1.1  SYSTEM  OVERVIEW 

The  Airborne  Optical  Systems  Testbed  (AOSTB)  leverages  technologies  and  systems  developed  for  the  ALIRT  open- 
terrain  mapping  system  and  the  MACHETE  FOPEN  3D  ladar.  The  AOSTB  engineering  team  took  advantage  of 
important  improvements  in  detector  technology  and  implemented  unique  scanning  modalities,  resulting  in  a  relatively 
low-cost  airborne  ladar  system.  The  hardware  components  have  a  flexible  roll-on/roll-off  capability  and  the  testbed  is 
suitable  for  operation  as  a  single  sensor  or  as  part  of  a  fused-sensor  suite  that  can  combine  down-  and  side-looking  ladar 
and  various  passive  imaging  modalities.  A  low-operating-cost  Twin  Otter  (TO)  aircraft  was  selected  to  host  the  payload 
for  our  airborne  demonstration.  This  platform  offers  flight  endurance  in  excess  of  4  hrs  at  ground  speeds  of  100  knots 
and  all  the  necessary  space  and  power  for  various  research  and  development  activities.  Figure  1  shows  a  picture  of 
MITLL’s  AOSTB  on  the  tarmac  at  Hanscom  Airforce  Base  (HAFB),  Bedford,  MA. 

1.1.1  Laser  and  Detector  Modules 

The  laser  is  a  1  W,  Q-switched,  Nd:YAG  laser  originally  built  at  MITLL  for  operation  on  the  ALIRT  platform  [3,  4]. 
The  laser  is  constructed  by  diffusion  bonding  a  short  piece  of  Nd:YAG  (laser  gain  medium)  to  a  similar  piece  of 
Cr4+:YAG  (saturable  absorber).  The  pump-side  face  is  coated  to  transmit  the  pump  light  (808  nm)  and  reflect  the  laser 
light  (1064  nm).  The  output  pulses  have  a  transform-limited  frequency  spectrum,  fundamental  transverse  mode  with 
diffraction-limited  divergence,  and  linear  polarization.  The  laser  has  a  pulse  width  of  approximately  500  ps  and  operates 
in  the  SWIR  spectral  region  at  a  wavelength  of  1064  nm.  The  electro-optical  receiver  is  a  state-of-the-art  256x64-pixel, 
50-micron-pitch,  GMAPD  array  optimized  for  operation  at  the  1064  nm  laser  transmitter  wavelength.  The  array  was 
built  on  a  framed  ROIC,  designed  and  fabricated  in  the  Microelectronics  group  at  MITLL.  Lincoln-built  256x64  arrays 
of  photon-counting  APD  detectors  are  integrated  with  on-chip  CMOS  digital  timing  circuits.  The  APDs  are  biased  to 
operate  above  breakdown  voltage  in  Geiger  mode,  in  which  an  electron-hole  pair  generated  by  the  absorption  of  a  single 
photon  initiates  an  avalanche  process,  causing  the  APD  to  break  down.  These  Geiger-mode  devices  are  advantageous 
because,  in  response  to  a  single  photoelectron,  they  yield  a  fast,  high-amplitude,  high-precision  digital  pulse.  At  3-V 
overbias  voltage  and  0  Celsius,  the  detector  exhibits  25%  detection  efficiency  and  10  KHz  dark  count  rate  with  negligible 
cross  talk  and  aflterpulsing.  Dark  count  rates  are  kept  low  by  cooling  the  APD  array  to  -10°C.  Background  noise  is 
minimized  through  a  combination  of  narrow-band  spectral  filtering  via  a  bandpass  filter  and  temporal  filtering  via  low 
duty  cycle/short-duration  range  gate  operation.  Further  details  on  the  fabrication  of  large-format  GMAPD  arrays 
receivers  and  passively  Q-switched  microchip  lasers  can  be  found  elsewhere  [2,  3].  As  soon  as  the  beam  is  pulsed,  a 
flash  pick-off  fiber  triggers  the  timers  behind  each  GMAPD  pixel  to  start  counting.  The  circularly  symmetric,  near- 
transform-limited  beam,  exiting  the  laser  is  shaped  by  a  pair  of  COTS  cylindrical  lenses  to  match  the  GMAPD  receiver’s 
4-to-l  aspect  ratio.  Each  individual  detector  pixel  has  an  IFOV  of  ~3 1  jarad,  resulting  in  a  ground  sample  distance 
(GSD)  of  ~7  cm  from  a  7.5  kft  flight  altitude  above  ground  level  (AGL).  The  transmit-path  optical  elements  adjust  the 
far-field  divergence  to  8x2  mrad  to  match  the  receiver  FOV  for  optimal  utilization  of  the  photons  in  the  3D  imaging 
process.  The  laser  exits  the  enclosure  through  a  gold-coated  broadband  mirror  and  is  directed  by  a  periscope  downwards 
and  to  the  fast-scan  mirror  (FSM).  The  returning  light  is  collected  by  a  custom-built  centrally-obscured  telescope 
assembly  and  focused  by  a  pair  of  adjustable  achromatic  lenses  onto  the  detector  array  after  first  passing  through  a  2-in 
diameter,  3-nm  FWHM  narrowband  optical  filter.  This  filter  reduces  the  amount  of  background  incident  onto  the 
GMAPD  during  daytime  measurements.  The  system  focus  can  be  adjusted  by  varying  a  micrometer  stage  which  in  turn 
changes  the  achromatic  lens-pair  spacing.  This  allows  us  the  flexibility  to  image  targets  at  a  close  range  (~90-m)  for 
ground  testing.  The  laser  and  detector  subassemblies  are  situated  inside  a  light-tight  box  instrumented  with  temperature 
and  humidity  sensors.  Dry  air  is  directed  into  these  boxes  through  a  tube  of  desiccant  to  control  the  dew  point  inside  the 
enclosures  and  reduce  the  chance  of  condensation.  The  scanning  system  utilizes  a  high-performance  mirror  made  by 
BAE  Systems.  The  hardware  was  originally  deployed  on  the  ALIRT  3D  mapping  system.  For  operation  on  AOSTB,  we 
rotated  the  scan  mirror  assembly  by  90  deg.  about  the  vertical  axis  in  order  to  optimize  its  operation  for  FOPEN.  In  this 
configuration,  we  take  advantage  of  the  increased  maximum  acceleration  about  the  mirror’s  short  axis,  along  the 
direction  of  the  platform  motion,  and  thus  allow  the  sensor  to  achieve  a  larger  number  of  views,  or  “looks”,  over  a  given 
target.  Each  look  at  the  target  is  defined  as  a  single  sinusoidal  scan  pattern  that  travels  once  across  the  imaged  area  on  the 
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ground  and  is  typically  varying  from  250x250  m2  to  lxl  km2.  We  can  program  the  mirror  to  scan  any  area,  straight 
below  or  to  either  side  of  the  aircraft,  at  the  desired  speed,  and  with  various  number  of  looks,  as  dictated  by  the  collection 
CONOPS.  With  an  increased  number  of  looks  of  a  given  area,  we  achieve  greater  angular  diversity  of  reflected  photons 
back  towards  our  detector.  This  translates  into  better  imaging  capability  at  the  human  activity  layer  (HAL)  in  FOPEN 
imaging  scenarios.  The  scan  mirror  command  generator  (SMCG)  records  the  GPS  position  from  an  Applanix  GPS/IMU 
and  precise  mirror  angle  encoder  values  corresponding  to  where  the  scan  mirror  is  pointing  during  a  detection.  In  order 
to  be  able  to  match  the  timestamps  between  the  scan  system  and  detector  system,  we  use  the  GPS’s  pulse-per-second 
(PPS)  signal  as  a  synchronization  pulse,  and  use  internal  oscillator  clocks  on  the  SMCG  and  APD  tower  FPGA  for 
further  precision.  The  angle-angle-range  (3D)  data  is  then  processed  through  a  variety  of  geometric  transformations  and 
coincidence  processing  algorithms  to  create  high-resolution  3D  point  clouds  [5].  Each  pixel  contains  range  information 
and  the  3D  image  can  be  displayed  in  a  variety  of  ways.  One  visualization  method  is  to  assign  a  different  color  to  each 
range,  and  apply  the  appropriate  color  to  each  pixel  in  and  displayed  in  a  two-dimensional  array.  Another  method  is  to 
render  a  3D  model  from  the  data  and  display  the  model  as  if  it  were  photographed  from  a  user-defined  aerial  perspective. 
Yet  another  method  is  to  create  a  point  cloud  and  project  these  points  onto  a  plane  representing  the  viewing  screen.  In  a 
point  cloud,  each  pixel  is  assigned  a  point  with  x  and  y  coordinates  corresponding  to  the  pixel  position  in  the  array  and  a 
z  coordinate  corresponding  to  its  range.  Due  to  the  kinetic  depth  effect,  the  human  brain  can  better  perceive  the  3D 
nature  of  the  point-cloud  image  when  the  projected  image  plane  is  rotated  as  if  the  observer  is  moving  around  the 
recorded  image,  or  equivalently  as  if  the  image  is  rotating  in  front  of  the  observer.  The  3D  movies  generated  after 
processing  easily  reveal  man-mode  shapes  and  targets,  providing  useful  information  and  actionable  intelligence. 

1.1.2  Laser  Radar  Link  Budget 

In  general,  the  laser  power  requirements  for  a  ladar  imager  depend  upon  several  parameters  including:  target  range, 
reflectivity,  the  two-way  propagation  path  loss,  the  receive  aperture  area,  and  the  detection  efficiency  of  the  receiver.  For 
a  1-W  laser  operating  from  an  altitude  of  2300  m,  receiver  aperture  diameter  of  10-cm,  with  80%  optics  transmission, 
45%  central  obscuration  receiver  telescope,  85%  transmission  narrowband  filter,  25%-efficient  256x64-pix  GMAPD 
array,  and  assuming  80%  two-way  atmospheric  transmission  and  30%  target  reflectivity,  we  expect  to  detect  on  the  order 
of  0. 15  photons  per  pixel  per  pulse.  This  signal  level  is  sufficient  for  3D  imaging  of  targets  in  the  open  and  under  foliage 
during  daytime  and  nighttime  conditions.  Moreover,  the  laser  is  invisible,  covert,  and  eye-safe  for  all  observers. 

1.1.3  Results  and  System  Performance 

The  spatial  resolution  of  the  AOSTB  ladar  system  was  measured  using  a  custom-built  modulation  transfer  function 
(MTF)  “bar”,  or  “panel”,  target.  The  MTF  has  varying  panel  widths  and  spacing,  as  shown  in  the  diagram  on  the  left  in 
figure  2.  The  ladar  data  shown  in  the  right  side  of  figure  2  shows  proper  optical  focus,  as  indicated  by  the  fact  that  all 
MTF  panels  are  spatially  resolved.  Examples  of  two  images  from  a  flight  over  Maynard,  MA  (target-scan  mode)  and 
Boston  shore  (line-of-communication  scan)  are  shown  in  figures  3  and  4,  respectively.  The  target-scan  shows  an  area  of 
over  500x500  m2,  which  took  on  the  order  of  10  sec  to  collect.  The  image  over  the  littoral  area  south  of  Boston, 
including  downtown,  covered  an  area  of  -500  m  wide  by  10  km  long  and  only  took  a  few  minutes  and  a  single  pass 
over  the  designated  area  to  collect.  The  coloring  is  set  according  to  height  while  the  brightness  is  set  according  to 
reflectivity.  Fusing  range  with  intensity  data  offers  additional  possibilities  for  a  variety  of  EOIR  applications.  The  view 
perspective  can  be  rotated  because  multiple  angled  look  gets  incorporated  into  this  3D  view.  To  demonstrate  our  typical 
FOPEN  capabilities,  figure  5  shows  two  images  taken  over  a  forested  area  near  Burlington,  VT.  Figure  5(a)  is  a  3D  point 
cloud  view  with  the  foliage  intact,  while  5(b)  has  the  foliage  removed  by  applying  a  range  cut  in  software.  This  was 
possible  because  our  system  is  capable  of  aggregating  multiple  looks  through  the  foliage,  which  allows  us  to  build  up  the 
necessary  signal  from  these  objects  as  required  for  detection  and  identification.  Multi-look  image  registration  along  with 
coincidence-processing  techniques  reveals  pathways,  roofs,  vehicles,  and  other  objects  of  interest  hidden  under  the 
foliage.  These  capabilities  are  of  interest  for  the  intelligence,  surveillance,  and  reconnaissance  missions. 
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1.1.4  Conclusion  and  Future  Work 

Over  the  last  two  decades,  MITLL  has  pioneered  the  development  of  enabling  technologies  and  systems  for 
high-sensitivity  scanning  3D  imaging  laser  radars.  Here,  we  reported  the  development  of  an  airborne  optical 
testbed  that  is  re-configurable,  allows  for  roll-on  roll-off  capability,  and  can  accommodate  active  laser  radar 
and  passive  imaging  sensors  on  a  low-cost  Twin  Otter  aircraft.  The  system  is  capable  of  more  than  100  kmA2 
per  hour  area  coverage,  with  spatial  and  depth  (range)  resolution  on  the  order  of  a  few  centimeters.  It  uses  a 
covert  and  eye  safe  invisible  laser  that  can  operate  day  and  night.  Current  and  future  AOSTB  mission  areas 
include  wide-area  down-looking  high-resolution  3D  imaging,  side-looking  and  up-looking  laser  ranging  and 
tracking,  and  sensor  fusion  with  conventional  EOIR  cameras  and  hyperspectral  payloads.  In  this  paper  we 
described  the  AOSTB  ladar  system,  presented  a  sample  from  the  recently  collected  high-resolution  3D  data, 
and  discussed  testbed  configurations  that  can  support  various  defense  and  non-DoD  applications. 
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narrowest:  4” 


Fig.  2.  Model  of  our  MTF  optical  resolution  table  (left).  Airborne  ladar  image  of  the  same  MTF  table  showing  good  spatial  resolution  of 

~7cm  (right). 


Fig.  3.  Target-scan  of  a  500  by  500  mA2  area  of  Maynard,  MA.  The  number  of  looks  employed  was  ~10.  The  scan  takes  about  10s  to  collect. 
Each  pixel  is  color  codded  with  range.  Intensity  information  can  be  derived  from  and  fused  with  the  angle-angle-range  data . 


Fig.  4.  Large-area  3D  ladar  image:  South  Boston  (lower  left)  and  downtown  Boston  (upper  right).  The  area  scanned  is  500-m- 
wide  by  10-km-long.  The  dark  areas  at  the  bottom  are  the  Atlantic  Ocean  and  coastal  waterways,  which  reflect  back  very  little 

light  at  our  SWIR  operating  wavelength  of  1064  nm. 
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Fig.  5.  Ladar  target  scan  of  a  forested  area  in  northern  Vermont.  On  the  left  (a),  we  show  a  3D  point  cloud  image  of  the  foliated  area.  The 
figure  on  the  right,  (b)  is  the  same  scene,  with  the  foliage  removed  in  processing,  revealing  a  tent,  a  bench,  a  car  and  a  truck  that  were  hidden 

under  the  trees. 
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